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BOOTSTRAP PERCOLATION ON A RANDOM GRAPH 
COUPLED WITH A LATTICE 

SVANTE JANSON, ROBERT KOZMA, MIKLOS RUSZINKO, AND YURY SOKOLOV 


Abstract. In this paper a random graph model Gr ^2 „ is introduced, which 
is a combination of fixed torus grid edges in and some additional 

random ones. The random edges are called long, and the probability of having 
a long edge between vertices u, u S (Z/VZ)^ with graph distance d on the torus 
grid is = c/Nd, where c is some constant. We show that, whp, the diameter 
D{G ^2 p^) = 0(logV). Moreover, we consider non-monotonous bootstrap 
percolation on G ^2 p^. We prove the presence of phase transitions in mean- 
field approximation and provide fairly sharp bounds on the error of the critical 
parameters. Our model addresses interesting mathematical questions of non- 
monotonous bootstrap percolation, and it is motivated by recent results of 
brain research. 


1. INTRODUCTION 

Bootstrap percolation on lattices has been extensively investigated in the last 
decades, and recently it has been considered on the classical Erdds-Renyi random 
graph Gn,p as well [14]. In this paper we consider a stochastic process of activa¬ 
tion propagation over the random graph which combines lattice with additional 
random edges that depend on the distance between vertices. A similar graph has 
been studied, by, e.g., Aizenman, Kesten and Newman [Tj - the so-called long-range 
percolation graph. In that model a pair of sites of d-dimensional lattice Z'^ is con¬ 
nected (or a bond is occupied) with probability that depends on the graph distance. 
In this paper we change the way probabilities are defined to get a sparser graph 
with respect to long edges. 

The n-cycle long-range percolation graph (a cycle lattice with n vertices) was 
considered in |1] where the probabilities of random edges decay polynomially as 
their distances increase. It was shown that the diameter of this graph is of the 
order of log A, assuming that the parameters are constrained to a certain param¬ 
eter region. The combination of a d-dimensional grid with certain random edges 
(decreasing in distance) was considered by Coppersmith, Gamarnik and Sviridenko 
[5|. They showed that under certain conditions on the dimension and probability 
p, the diameter is either 0(logA) or , where the power coefficient rj satisfies 
0 < T] < I. Bollobas and Chung |6| investigated the combination of an n-cycle with 
a random matching. Clearly, the n-cycle has diameter [n/2j. However, a random 
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matching reduces the diameter drastically and it becomes (1 + o(l)) log 2 n. Later, 
Watts and Strogatz introduced the ’’small world” model on the vertex set of the 
n-cycle, where the edges are rewired at random with probability p, starting from 
a circle lattice with n vertices and k edges per vertex. This construction allows 
to ’tune’ the graph between regularity (p = 0) and disorder (p = 1). A different 
version of the ’’small world” model has been described by Newman and Watts [l8]. 
Here, again an n-cycle was considered and the edges of the cycle were fixed. In 
contrast to the original formulation m, however, in [TS] random edges were added 
with some probability instead of rewiring the edges of the cycle. This approach 
results in a smaller diameter for a given graph size. There has been a lot of interest 
in studying scaling behavior and phase transitions in inhomogeneous random graph 
models, see, for example [7]. 

In [Hj, a theory of bootstrap percolation has been developed on Gn,p regarding 
the size a of the set of initially active sites. Results include sharp threshold for 
phase transition for parameters p and a, and results for the time t required to the 
termination of the bootstrap percolation process. 

Recently, Turova and Vallier [20] considered bootstrap percolation on the com¬ 
bination of the lattice and the random graph Gn^p, where the edges of and 
Gn,p are selected with probability q and p, respectively. Sharp threshold for phase 
transition was derived. The authors got asymptotic results for the time when the 
bootstrap percolation process stops. 

Here we consider a random graph G that is built as follows. We start with 
the lattice over a {N -I- 1) x {N + 1) grid; for the sake of simplicity we assume 
periodic boundary conditions. Thus, we have a torus = (Z/NZ)'^, with the short 
notation Z^. The set of vertices of G consists of all vertices of Z^, in total N'^ 
vertices. All the edges from the torus Z^ are included in the graph G. In addition, 
we introduce random edges as follows. For every pair of vertices we assign an edge 
with probability that depends on the graph distance d between the two vertices, 
i.e., d is the length of the shortest path between the given pair of vertices in the 
torus grid. Accordingly, the probability of a long edge is described as follows: 

(1.1) pd = P ((m, v) e E{G) I dist{u, v) = d) = -^ X d~°‘, 

where c and a are positive constants, d > 1 (no multiple edges are allowed between 
any pair of vertices) and N is large enough so that each p^ < 1. We assume a = 1 
throughout this study. We will denote this model the graph. The edges 

of the torus are called short edges, while the randomly added ones are called long 
edges. 

The model introduced in this paper is also motivated by the structure and op¬ 
eration of the neuropil, the densely connected neural tissue of the cortex nuns]. 
The human brain has about 10^^ neurons. Typically, a neuron has several thou¬ 
sands of connections to other neurons through synapses, thus the human brain has 
^ 10^® synaptic connections. Most of the connections are short and limited to the 
neuron’s direct neighborhood (in some metric), forming the so-called the dendritic 
arbor. In addition, the neurons have a few long connections (axons), which extend 
further away from their cell body. In general, there are several thousands short 
connections in the dendritic arbor for one distant connection represented by a long 
axon. We use to model the combined effect of mostly short connections and 

a few long connections. It is more likely to have in brains shorter connections than 
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longer ones, which is a fact captured in the definition of pd, as pd is decreasing in 
the graph distance d. 

There are two types of neurons in the brain, namely excitatory and inhibitory 
ones. The type of a neuron describes the function of the neuron in the brain, 
e.g., excitatory (inhibitory) neurons excite (inhibit) the neurons to which they are 
connected. It is known that there are much more excitatory neurons than inhibitory 
neurons in the cortex; the ratio of inhibitory to excitatory neurons is typically 1 /4 
m- Based on neuroscience studies it is expected that pure excitatory populations 
can maintain non-zero background activation level, while interacting excitatory 
and inhibitory populations are able to produce limit cycle oscillations [HI US]. 
This paper focuses on conditions required to sustain non-zero activity level in pure 
excitatory network. 

The present work is organized as follows: first we describe some properties of the 
introduced random graph We derive bounds on the diameter of this graph 

and describe its degree distribution. The second part of this paper is devoted to the 
study of activation processes. To simplify the mathematical treatment we analyze 
the activation as a stochastic process in mean-field approximation |2] , for which we 
derive conditions for phase transitions in the presence of single type of (excitatory) 
nodes. Activity propagation in graphs with two types of nodes (excitatory and 
inhibitory) is the objective of future studies [IB] . 

We will use the following standard notation; for non-negative sequences am and 
bm, a,m = 0{bm) if am < cbm holds for some constant c > 0 and every to; am = 
Q{bm) if both am = 0{bm) and bm = 0{am) hold; am ~ bm if lim^-foo amjbm = 1; 
«m = o(bm) if limm_,,oo amjbm = 0. A sequence of events A„ occurs with high 
probability, whp, if the probability P(A„) = 1 — o(l). 


2. Properties of G^s 


First notice that the expected number of long edges Ei C E{Gjp^^p^) is propor¬ 
tional to N"^. 

Claim 1. E(|A,|)~(2cln2)7V2^ i.e., lim = 1- 

N^oo 2cN^ In 2 

Proof. Indeed, the number of vertices jA^I in which are exactly at distance d 
from a fixed vertex is 


Ad, l<d< lN/2\ 

A{N-d), lN/2\<d<N 

for N odd, and 

'Ad, l<d<N/2 

Ad-2, d = N/2 

A{N-d), N/2<d<N 
1, d=N 

for N even. The number of pairs of vertices in Z^ having distance d is ^ L 
Therefore, for N odd 

N 


|A.| = 


|A.| = 




d=2 


E 


2 Nd 

:=2 d=N/2+l 


AN^{N-d) c 

2 m 
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(2.1) = (2cln2)Af2_^0(Af) - (2cln2)iV^ 

For N even a similar computation gives the same result. 


□ 


2.1. Degree distribution. The degree distribution of a vertex v G with 

respect to long edges can be approximated by Poisson distribution. Let W be the 
random variable describing the degree of a particular vertex v considering long 
edges only. Then clearly, the degree of a vertex v G considering the short 

edges, too, is IF + 4. 


Lemma 1. The prohahility that a vertex has degree k considering only the long 
edges is given by 


( 2 . 2 ) 


F{W = k) 


F n(t')(U“( 

—t> ■>=9 ^ * / 


^2 “1“ • • • ^ ^ ^ 


C \|Ai|-fci 

m) 


The total variation distance 

(2.3) drv {C{W),Po{\)) = = j) - = j)l = 0(l/iV), 

j>0 


where the random variable Y has Poisson distribution Po{X), with A = 4c In 2. 


Proof. The probability of the event Ai that a vertex has ki edges of length i is 
clearly 


(2.4) 


P(A0 




Therefore, the probability that a vertex has degree exactly k is 


(2.5) ¥{W = k) 


u 



N 

E IfPiA) 

— k i —2 


= E 

k2~\~ • • •~\~kj\j’—k 



|A,|-/c. 


The last expression is not very convenient to use. However, a standard Poisson 
approximation can be given using Le Cam’s argument see also e.g. [5]. Pick 
an arbitrary vertex v and let enumerate the other N'^ — 5 vertices hy Ui, i = 
1,... , — 5, excluding the nearest neighbors, i.e., vertices at distance 1. The long 

edges that connect the vertex v to other vertices of the graph are independent 0-1 
random variables with Bernoulli Be(pi) distribution. In other words, let L = 1 be 
the event that there is an edge between vertices v and so that P(/i = \) = pi 
and P(/j = 0) = 1 — Pi, where Pi may in general vary for different i. Consider now 

the degree W = Yi=i~ of vertex v. Let 

N^-5 

Ai = Pi = 4cln2 + 0{1/N), 

i=l 


where the last equality follows from Eq. (2.1). By triangle inequality, 

(2.6) drv {C{W), PoiX)) < drv (^(tF), Po(Ai)) + drv (Po(Ai), Po(A)) 
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The first term, by Le Cam m, see also O Theorem 2.M], is at most 

N^-5 

Y. = 

(2.7) + 
and by Theorem l.C (i) in [3] 

(2.8) drv (Po(Ai), Po(A)) = O (|Ai - A|) = O . 

□ 


^ \Ad\pl < Y (]^) 

d^2 d^l d^l 

d=N/2+l d=l ^ ' 


Clearly, Lemma also implies that in Eq. 
j)-F{Y = j)\=0{l/N). 


(2.3) each term 


satisfies |P(1T = 


2.2. The diameter of Next we show that the addition of long edges to 

the torus grid reduces significantly (from linear to logarithmic in the number of 
vertices) its diameter. 


Theorem 1. There exist constants Ci,C 2 , which depend on c only, such that for 
the diameter D{Gi 2 ^^p^) the following hold. 

Ji^P(c'ilogiV< T>(Gz^,pJ < C' 2 logA^)) =1, i.e., D{Gzi,pJ = Qi^ogN), '^^P' 


Proof. The lower bound is trivial. The expected degree E(d(u)) of a vertex v by 
Claim is a constant k = k{c). Thus, the expected number of vertices Am we 
can reach in at most m > 0 steps from a given vertex v is less than or equal to 
1 + ~ 1)*“^. For TO > 3, this is less than fc™, and thus, by Markov’s 

inequality, 


(2.9) 


n^m >N^)< 


E(^rr, 

iV2 


< 


fc"* 

N2- 


If we choose m < Gi \ogN with Gi sufficiently small, the probability in Eq. (2.9) 
tends to zero, i.e., even from a given vertex v we cannot reach all vertices within 
distance Gi log N. Hence, Gi log N bounds the diameter from below. 

To prove the upper bound, partition the vertices of G^j^^p^ into consecutive 
kx k blocks Bij,i,j = 1,...,^, where A: is a constant k{c) to be chosen later. 
(For simplicity, we will assume that everywhere divisibility holds during the proof; 
otherwise we let some blocks be (fc + 1) x (fc + 1).) Define the graph G' as follows. 
The vertices are the blocks, and two blocks Bi j and Bk,i, (1, < i, j, k,i < N/k) are 
connected iff there is a long edge from a vertex of Bij to a vertex of Bk,t in Gjp^^p^. 
We obtain a random graph on N'^/k'^ vertices where the edge probabilities can be 
obtained from the ones of Gij^^p^. For an arbitrary pair of vertices Bij and Bk,i, 
the probability of the event that they are connected is bounded from below 

by the probability, that two blocks which are most distant from each other in 
are connected. Therefore, for large N, 




> E(^l,l;JV/(2fc),Ar/(2fe)) — 1 - '^(^1,1,^,^) ^ 1 “ (1 -Pn)^ 

= 1-(l->cfcV27V2. 
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For the second inequality we picked the two most distant vertices from each block, 
and the last one follows from < 1 + a;/2 for a: < 0 sufficiently close to 0. 

By, e.g.. Theorem 9.b in the seminal paper of Erdos and Renyi m there is a 
constant Ci such that in the Erdos-Renyi random graph Gn,p with p = c\/n there 
is a giant component on at least, say, n/2 vertices, whp. Choosing 

fc > (2ci/c)^/^ 

we get that the probability that G has an edge for arbitrary pair of vertices is at 
least 

ck‘^l2N^ > cik^/N^. 

Since the edges of G are chosen independently, it will contain a giant component 
on at least N‘^/2k'^ vertices, whp. The diameter of the giant component of Gn,p 
with p = cijn is known to be of order O(logn), whp. (See, e.g. Table 1 in [S].) 

First, assume that vertices u,v G are contained in blocks B{u) and 

B(v) which are vertices of the giant component in G\ Find the shortest path, 
say, B{u) = B{xo), B{xi), B{x 2 ),..., B{xm) = B{v), between B{u) and B{v) in 
G'. Let (a;o,a;i), {x'i,X 2 ), {x 2 ,X 3 ), ..., {x'.^_i,Xm), Xi,x'^ G B{xi) be the edges in 
inducing this path in G'. 

Now go from u to Xq in B{u) along short (Z^) edges. Jump from xq to Xi. Then 
go from xi to x'l in B(xi) along short edges. Jump from Xi to and so on. The 
total length of the path from u to v, will be at most 

m + 2k{m + 1) < {2k + l){m + 1). 

Indeed, we make m jumps, and within each block we make at most 2k steps along 
short edges. Since m = O(logiV), whp, the proof of this case is finished. 

Next we show that, whp, every vertex v G is close to some block B of 

the giant component in G. Indeed, by symmetry, the set A of vertices in the giant 
component can be any set of vertices of the same size, with the same probability. 
Therefore, one can regard A as a uniformly random subset on at least half of the 
vertices in G'. 

For some large constant D, the number of vertices with distance at most D^J\og^^ 
from a fixed vertex v in lA is 

^ 4d > log2 N, 

d=l 

i.e., this neighborhood contains a vertex from at least 

4£>2 iog2 N 

P 

blocks. Since A contains at least half of the vertices in G, the probability that 
none of those blocks is in A is 

logo N . J-.0 n 2 

< 2 - 

Therefore, the probability that there is a vertex v G Gj 2 ^ p^ for which there is 
no vertex u within distance iJplog 2 N such that B{u) € A is 

assuming that D is large enough. 
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Now, consider arbitrary two vertices u,v € If one, or neither of them 

is in block from A, then, whp, each of them can reach a block from A within 
D,y\og 2 ^ steps in Z^, and then proceed as in case B{u),B{v) G A. Since the 
number of additional steps whp is 0(-\/IoglV), the proof is finished. □ 


3. Activation process on the random graph 

Now we introduce a stochastic process on the graph we have just built. Each 
vertex is described by two variables, namely, the type of the vertex and its state. 
The type of the vertex is either excitatory [E) or inhibitory (/). The other variable 
represents the state of the vertex, which can be active or inactive. In other words, for 
each vertex we attribute a 2-dimensional vector where each coordinate is a Bernoulli 
random variable. The type is selected at the start and it remains unchanged through 
the process, while the state of the vertex changes during the process according to 
some rules specified next. 

Let A{t) denote the set of all active vertices at time t, while AE^t) and Aj{t) 
are the sets of active vertices of type E and I at time t, respectively; A{t) = 
AE{t) UAj{t). We also define a potential function Xv{t) for each vertex v such that 
Xv{t) = 1 if vertex v is active at time t, and Xv{t) = 0 if u is inactive. Therefore, 
Ai{t) = {v G I Xvit) = 1 & T is of type i}, i G {E,I}. At the beginning, 

let A(0) be a random subset of vertices with each vertex active with probability 
p, independently of its type and of all other vertices. Each vertex may change its 
activity based on the states of its neighbors. For a vertex v of type E, the evolution 
rule is 


(3.1) 


Xv{t + 1 ) = 1 



W- 


(v) 


(t) > k 


where N^{v) and {v) denote the subsets of vertices in the closed neighborhood 
of the vertex u, of type E and /, respectively; and 1 is the indicator function. Here 
fc is a nonnegative integer that specifies a threshold required for the node to be in 
the active state. For a vertex v of type /, the following rule holds: 

(3.2) 


Xv{t + l) = 1 


\.u^N^{v) 


Xu{t) 


(v) 


Xuit) > fc = 1 


\u^N{v 


Xuit) > k 


where N{v) = N^{v) U (v) is the closed neighborhood of vertex v. Notice, that 
vertices of type E and I have different roles and influence each other differently. 

Observe, that the set of active vertices does not necessarily grow monotonically 
during the activation process even in the absence of nodes of type /, whereas mono¬ 
tonicity is typically assumed in most bootstrap percolation models. In this paper 
we focus on activation processes having only type E vertices. In this case, according 


to Eq. (3.1) we have the fc-rule, i.e., a vertex will be active at the next time step 


if it has at least k active neighbors including itself. We assume for simplicity that 
k is not greater than 3 in the present study. Notice that if there are only local 
edges, the case k = 3 yields bootstrap percolation with majority rule. The choice of 
small k is motivated by the fact that there are vertices with degree 4 with positive 
probability. Therefore, if k could be 5 or more, then there would be vertices that 
cannot become active unless they were activated at the beginning. 





SVANTE JANSON, ROBERT KOZMA, MIKLOS RUSZINKO, AND YURY SOKOLOV 


4. Mean-field approximation for single type of nodes 

As we mentioned above, we assume that there is only one type of nodes {E). 
Moreover, for simplicity, we consider here the mean-field (MF) approximation of 
the model. The mean-field approximation assumes that the activation and degrees 
of the various nodes are well-mixed; hence we ignore any dependencies between 
activation and vertex degrees, as well as any dependencies between the state of 
a vertex and the state of its neighbors [5]. Effectively, we sample a new set of 
neighbors at each step. This, in particular, implies that the MF approximation 
does not depend on the topology of the torus but only on the degree distribution 
and on the cardinality of A(t). Thus, the transition probabilities from one state 
to another depend only on the number of active nodes. Furthermore, we assume 
that the vertices are activated independently of each other, ignoring the small 
dependencies between degrees and activities for different vertices. 

4.1. Phase transition in mean-field model. Let pt = A{t)/N‘^, where is 
the size of the torus. Clearly, pt S [0,1] and it defines the density of active nodes 
at time t. 

The mean-field analysis is an analytical approach of finding phase transitions in 
the stochastic process by averaging the system over space. Thus, the mean-field 
model reduces the analysis of a system with distributed components to a system 
with a single component. Let f{pt) denote the conditional mean of pt+i given pt, 
for the mean-field approximation. The main task of the mean-field approximation 
is to find solutions to the fixed-point equation x = f{x), where the solutions of this 
equation are called fixed points. This approach is based on the observation that the 
critical behavior of the original system often occurs near the unstable fixed points 
of mean-field model [3 [IS]. For a discrete time dynamical system, a fixed point is 
called stable if it attracts all the trajectories that start from some neighborhood 
of the fixed point. Otherwise, a fixed point is unstable. If f{x) is continuously 
differentiable in an open neighborhood of a fixed point Xq, a sufficient condition for 
xo to be stable or unstable is |/'(a;o)| < 1 or \f'{xo)\ > 1, respectively; see, e.g., 

m- 

Let Bin(n,p) be a binomial random variable. Then the density pt in the mean- 
field model satishes the following stochastic recursion. Recall that deg(i;) denotes 
the degree with respect to the long edges only, so the total degree of a vertex v is 
deg(z;) -I- 4. 

Lemma 2. For the mean-field approximation in a torus with N'^ nodes, pt is a 
Markov process given by 

(4.1) N^pt-i-i =Bin(Af^pt,/+(pt)) + Bin(Af2(l-pt),/"(pt)), 
where 

N'^-l n+1 , ^ 

(4.2) f+{x)= ^ P(deg(T)=n-4)5] . ” )a;*-i(l-x)"-*+\ 

n—4 i—k ^ ' 

N'^-l ^ / \ 

(4.3) f~{x)= ^ P (deg(T) = n — 4) ^ f ” ja;*(l — a;)"“L 

Moreover, given pt, pt+i has mean f{pt) and variance g{pt)/N‘^ where 

(4.4) f{x)=xf~^{x)-\-{l-x)f~{x), 


9 


(4.5) 


g{x) = a:/+(x)(l - /+{x)) + (1 - x)f (x)(l - /+(x)). 


Proof. Clear, since in the MF approximation, each vertex is assumed to have 
deg(u) + 4 neighbors, each active with probability pt, independently of each other 
and of deg(u); furthermore, different vertices are regarded as independent. □ 

Remark 1. In our model, the activation of a vertex is deterministic given the 
number of active vertices in the closed neighborhood. More generally, one can con¬ 
sider a model where an active [inactive] vertex with i active neighbors is activated 
with some probability pf [p~] (where pf^ are some given probabilities). In this more 
general case, (4.2)-(4.3) become 


—1 n-|-i / \ 

(4.6) f^ix)= ^ P(deg(u) =n-4)^p+( . ” )a;*"^(l-a;) 

n —4 i —1 ^ 

N^-1 n y ^ 

(4.7) f~ix)= ^ P(deg(u) =n-4)^pC(^)a;4l-x)”"h 


n +1 


n—2+1 


n,—4 


2 = 0 


Lemma shows that the conditional variance of pt+i is g{pt)/N"^ = 
thus pt+i is well concentrated for large N, and we can approximate pt+i by the 
mean /(p*). 

The function /(•) given by (4.4) can be simplified to 

(4.8) f{x)=xf+{x)-^{l-x)f~{x) 


N^-1 


n +1 


n 

i—1 


c\l-x) 


= P(deg(u) =n-4)^ 

n —4 i—k 

N^-l 

+ X! P(deg(u) = n - 4)^ ( 7 - x) 


n—2+1 


1=4 


i—k 


n—2+1 


N ^-1 


^n+1 


= ^ P (deg(u) = n - 4) ^ 


n —4 


\ i—k 


n + 1 


a;*(l — x) 


n—2+1 


This can also be seen directly, since if deg(u) = n — 4 with respect to the long 
edges, then the closed neigborhood of v contains n+1 vertices, of which k have to 
be active for activation of v, and in the MF approximation, these n + 1 vertices are 
active independently of each other. 

In Section |2.1| we showed that the degree distribution can be approximated by 
Poisson Po(A) distribution. We use the last fact to approximate f{x). Consider 
the function 


(4.9) 




/» = AW = ^—— ^ 


n+1 


^ (n — 4)! = 

n —4 ^ ^ i—k 

The difference between f{x) and f(x) can be bounded by 
(4.10) 


x^(l — x) 


n—2+1 


l/(+ - fix)\ < ^ 


2=4 


P (deg(u) = n — 4) — 




(n — 4)1 


n +1 

E 

i—k 


n + 1 


a;*(l — x) 


n—2+1 
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1=4 


' (deg(ti) = n — 4) — 






(n — 4)! 

where the last equality follows from Lemma 1. 

4.2. Derivation of criticality for various k values. We rewrite f = fk defined 
in (|4.9|) as 


(4.11) 


— e-V" fn + 5 


E 


n=0 


\ i—k 


x^{l — x) 


n+5 —2 


For A: = 0,1, 2 and 3, respectively, the internal sums in Eq. (4.11) are 

n+5 


(4.12) ^ 


2 = 0 
n+5 


(4.13) ^ 


2 = 1 
n+5 


(4.14) 5] 


2=2 

n+5 


(4.15) 5] 


i=3 


n + 5 


n + 5 


n + 5 


n + 5 


a;*(l - a;)"+5-* = 1, 

x\l-xY+^-^ = 1- (l-a;)"+5, 


'in+4 


x^l - x)^+^-^ = 1 - (1 - a;)"+® - (n + 5)(1 - x) 

x\l - a;)”+®-* = 1 - (1 - a;)"+5 - (n + 5)(1 - x)”++ 
(n + 5)(n + 4) 


-(1-a;) 


n+3^2 


Hence, (4.11) yields, by simple calculations. 


(4.16) fo[x) = 


n=0 


n\ 


= 1 , 


oo 


(4.17) /i(x) = ^ (1 - (1 - xTY = 1 - e-"“(l - x)^ 


n=0 

oo 


(4.18) / 2 (x) = V (1 - (1 - x)”+5 - (n + 5)(1 - xT+^x) 

n\ 


n=0 


(4.19) h{x) = Y 


= 1 — e ((1 — x)^ + 5a;(l — x)'^ + Aa:(l — a;)®) , 

e-^A” 


n=0 


n\ 


1 - (1 - a;)”+5 - (n + 5)(1 - a;)”++ 
(n + 5)(n + 4) 


-(l-x) 


n+3^2 


A2 


= 1 - ( (1 - xf + 5a;(l - x)^ + Ax(l - xf + ya;2(l - xf 

+ 5Ax^(l — x)^ + 10x^(l — x)^ ]. 


Proposition 1. Let fk{x) : [0,1] —>■ [0, 1] be the family of maps for k = 0, 1, 2, 3 
defined by (4.16)-(4.19). These maps have the following fixed points, for any A > 0.' 
(i) for k = 0 the only fixed point is 1 and it is stable. 
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(ii) for k = 1 there are two fixed points: 1 is stable and 0 is unstable. 

(iii) for k = 2 there are three fixed points: 0 and 1 are stable and X 2 {X) € (0,1) 
is unstable; 

(iv) for fc = 3 there are three fixed points: 0 and 1 are stable and a; 3 (A) € (0,1) 
is unstable. 

Proof. For k = 0, the equation fo{x) = x reduces to just 

(4.20) x = l. 

In this case the fixed point a; = 1 is stable since /o(ai) = 0. 

For k = 1 , fi ( x ) = X can be written 

(4.21) (1 - a:)e^“^ = (1 - a;)^ 

This equation has only two solutions 0 and 1 in [0,1], where 0 is an unstable fixed 
point since /((O) = 5 + A > 1, while 1 is a stable fixed point because /((I) = 0. 

For k = 2 , f2 { x ) = X we obtain 

(4.22) 


(1 — x)e^^ = (1 — a;)"‘(l + 4x + Aa; — Ax^). 


Clearly, 0 and 1 are solutions of (4.22). Divide both sides of (4.22) by 1 — x and 
let g{x) = e^^ be the LHS and h{x) the RHS of the resulting equation. 

Since g(0) = h{0) = 1, (;(1) = > 0 = h{l) and h'{0) = 1 + A > A = 5^(0), 

h{x) = g{x) has a solution in (0,1). 

This solutions is unique. To see this, first observe that h"{x) = 0 has a unique 
solution Xinfl S (0,0.5). Indeed, h”[x) is a polynomial of degree three, i.e., it has 
at most three real roots. Clearly, h''(\) = 0, and since h"{fS) = —8A — 18 < 0 
and h"(0.5) = 0.5A + 3 > 0, by the intermediate value theorem h"{x) = 0 has a 
solution in (0, 0.5). Moreover, h"'{\) = —30 < 0 and the leading coefficient of h"{x) 
is positive; therefore, the third solution has to be greater than one. 

Also, observe, that h'{x) = 0 has a unique solution Xmax € (0,1). Indeed, 
h'{x) is a polynomial of degree four, i.e., it has at most four real roots. Since 
h'{\) = h''{l) = 0 and /i'"(l) < 0, 1 is a root of multiplicity two of h'{x) = 0 and 
h'{\ ± e(A)) < 0 for e{X) sufficiently small. Since the leading coefficient of h'{x) is 
positive, h'{x) must have two additional real roots, such that one is bigger and the 
other is smaller than 1. Moreover, h'{0) > 0, therefore, there is a unique root Xmax 
in (0,1) and h{x) has a unique maximum in Xmax on (0,1). 

Since h{x) is concave on [0,Xinfl) but g{x) is convex, by Rohe’s theorem they 
may have at most two intersections over that interval and one of those is at x = 0; 
furthermore, if there is an intersection in (0,Xinfl), then h(xinfl) < g(xinfl). 

On (xinfl,l), h''{x) > 0 and since also h'{l) = 0, it follows that h'{x) < 0 
and h{x) is decreasing on (xinS, 1). Furthermore, g{x) is increasing, and thus the 
functions h{x) and g{x) may intersect at most once in (xinfl, 1); moreover, if there 
is such an intersection, then li(xinfl) > g(xinfl). 

Consequently, h{x) = g{x) has a unique root X 2 (A) in (0,1), and thus X 2 (A) is 
the unique fixed point of f 2 {x) in (0,1). In this case 0 and 1 are stable fixed points 
since /^(x) is zero at those points. The function / 2 (x) is increasing on [0,1] and 
since the fixed points 0 and 1 are stable, one can see that X 2 (A) is an unstable fixed 
point. 

For k = 3, fsix) = x reduces to 

(4.23) (l-x)e^"’ = ^(1 -x)3(2 + (6+2A)x+x2(12+6A+A2)-x3(8A+2A2) + AV). 
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We note that Eq. (4.23) has solutions 0 and 1 for any A. 

There is also at least one solution a; 3 (A) G (0,1) for any fixed A > 0. Indeed, 
divide each side of Eq. ( |4.23 l by (1 — x) and denote the LHS and the RHS of the 
resulting expression by g(x) = and h{x), respectively. The fact that g{0) = 
h{0) = 1, g{l) = > 0 = h{l), and Ii'(O) = 1 + A > A = g\0) verifies the 


statement. 

Thus g{x) = h{x) has at least two solutions in [0,1), including a: = 0, so by 
Rolle’s theorem g'{x) = h'{x) has at least one solution in (0,1). If g{x) = h{x) has 
more than one solution in (0,1), then g'(x) = h'{x) has by Rolle’s theorem at least 
two solutions in (0,1). Hence, it is enough to show that g'{x) = h'{x) has a unique 
solution in [0,1] to guarantee that the solution a; 3 (A) of g{x) = h{x) in (0,1) is 
unique. 

The first two derivatives of h{x) are 


(4.24) h'ix) = 3X^x^ - (lOA^ + 20A)a;'‘ + + 44A + 24)x^ 

- (OA^ + 27A + 27)x^ + (A^ + 2A + 2)a; + A + 1 

and 


(4.25) h''{x) = ISA^a:^ - (40A^ + SOA)^^ + (36A^ + 132A + 72)x‘^ 

- (12A2 + 54A + 54)a; + A^ + 2A + 2. 


Eirst we show that h"{x) = 0 has two solutions on [0,1], noting that 0 and 1 
are not solutions since h”[Q) = A^ + 2A + 2 > 0 and h"{l) = 20. If p{x) is 
a univariate polynomial of degree n then the variation of signs 14(p) of p{x) at 
cc = c is the number of sign changes between consecutive elements in the sequence 
{p^^Hx)}J^q {p(c),p'(c),... ,p^"^(c)} (ignoring any terms that are 0). By 

the Budan-Fourier theorem, the number of roots on [0,1] of h"{x) = 0 is Vb(^") ~ 
Vi{h'') — 2k where /c e N U {0}. We have at x = 0 


(4.26) 


and at a: = 1 

(4.27) 


h"{Q) 

= A^ + 2A + 2 

h"'{0) 

= -12A2-54A-54 


= 72A^ + 264A + 144 


= -240A2 - 480A 


= 360A^ 

h"{l) 

= 20 

h"'{l) 

= -30A + 90 


= 12A^ - 216A + 144 


= 120A^ - 480A 


= 360A2 


Clearly, V(^{h") = 4 for any A > 0. The derivatives h"'(l), and as 

functions of A > 0, change sign at A = 3, 9 ± \/W and 4, respectively. It is easily 
verified by inspection, considering the intervals (0,9 — a/G!!], (9 — a/GII, 3], (3,4], 
(4, 9 + v^] and (9 + a/G!), oo) separately, that Vi{h") = 2 for every A > 0. 
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Therefore, the number of solutions on [0,1] to h"{x) = 0, counted with multi¬ 
plicity, is at most Vf^{h”) — Vi{h”) = 2. Furthermore, by (4.26) and (4.27) h''{Q) > 0 
and h''(l) > 0 for any A > 0. However, h"{0.2) = —0.256A^ — 4.16A — 5.92 < 0 
for any A > 0. Thus, h''{x) = 0 has exactly two roots Xi and X 2 in [0,1], and 
0 < cci < 0.2 < a;2 < 1. 

Consider now the third derivative of the function h{x), 

(4.28) h'''{x) = mX^x^ - 120A(A -f 2)x‘^ + {12X^ + 264A + 144)a; - 12A^ - 54A - 54. 


For X = 0.2, 


h"'{Q.2) 

/i(^)(0.2) 

h^^\{).2) 

h^^\{).2) 


-imX^ - 10.8A-25.2 
31.2A2 -f 168A -f 144 
-168A2 -480A 
360A2 


These alternate in sign, for any A > 0. Thus, by a Taylor expansion at x = 0.2, 
h"'{x) < 0 for X < 0.2. 

Consider first the interval [0,0.2]. Since h'" < 0 there, h' is concave, and since 
g' is convex, h' — g' is concave. Furthermore, h'{Q) — g'{Q) = 1 > 0. It follows 
that h' — g' has at most one root in [0,0.2], and that if there is such a root, then 
h'{0.2) < g'(0.2). 

Next, on the interval [0.2,X 2 ) C (xi,X 2 ), we have /i"(x) < 0 and thus h' is 
decreasing. Since g' is increasing, h' — g' has at most one root in (0.2, X 2 ), and if 
there is such a root, then h'{Q.2) > ^'(0.2). 

Finally, in the interval [x 2 ,l], h” > 0 and thus h' is increasing and h'{x) < 
h'{\) = 0. Since g' > 0, there is no root of h' = g' in [x 2 ,1]. 

Combining these cases, we see that there is at most one root of g'{x) = h'{x) 
in [0,1]. As said above, this implies that there is a unique root X 3 (A) in (0,1) of 
g{x) = h(x), and thus a unique fixpoint X 3 (A) in (0,1) of 

One can check that /^(x) = 0 at 0 and 1, and thus these two fixed points are 
stable. Furthermore, J^{x) is increasing on [0,1] and using the stability of the fixed 
points 0 and 1, and the uniqueness of the fixed point X 3 (A), it follows that X 3 (A) is 
an unstable fixed point. □ 


For all cases considered above 0 is a fixed point of /. As we noted before, the 
error /(x) — /(x) is 0 at 0, so this fixed point is also a fixed point of /(x) for any 
N. If X is an unstable fixed point of / with /'(x) > 1, then (4.10) implies that /(x) 
has a fixed point shifted from x at most by 0(1/A^). These arguments are valid in 
case A is a fixed constant independent of N. 

Let p denote the probability that a node is initially activated and Pc be the 
nontrivial solution(s) derived above. Since pt is a Markov process, for the mean- 
field approximation we obtain the following theorem. 


Theorem 2. In the mean-field approximation of the activation process A{t) over 
random graph there exists a critical probability pc such that for a fixed p, 

with high probability for large N, all vertices will eventually be active if p > Pc, 
while all vertices will eventually be inactive for p < Pc- The value of Pc is given as 
the function of k and A as follows: 

(i) For k = 0 and any X, Pc = 0 and all vertices will become active in one step 
for any p. 
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(ii) For k = 1 and any A, Pc = 0, i.e., for any fixed p > 0, all vertices will 
eventually become active with high probability. 

(iii) For k = 2 and any X, pc = X 2 {X), where a: 2 (A) S (0,1) is a nontrivial 
solution to X = f 2 ix). 

(iv) For k = 3 and any X, Pc = a^ 3 (A), where X 3 {X) G (0,1) is a nontrivial 
solution to X = f^{x). 


Proof. Consider the case 0 < p < Pc (and thus (iii) or (iv)); the case Pc < P < ^ 
is similar and (i) and (ii) are trivial. In the limit as iV —> oo, po = p and pt is 
deterministic with pt+i = f{pt)- Since p < Pc, the sequence pt = P(p) converges, 
as t —)■ 00 , to the fixpoint 0. Furthermore, because /'(O) = 0, the convergence is 
(at least) quadratic, and in particular geometric. 

Now consider a hxed positive integer N. The deterministic sequence /*(p) just 
considered reaches below 1/N for t > tjq, where tjq = O(logiV). The sequence pt 
is a random perturbation of f*{p). In each step, we have two sources of error: the 
difference in mean f{pt) — f{pt) = 0(l/iV), by (4.10), and the random error coming 
from the binomial distributions in ( |4.1[ ), which by a standard Chernoff bound is 
0(7V“°'®) with probability 1—0(fV“ '), say. Since further |/'(a;)| < 1 for small x, the 
combined error from the first t^ steps is tf^{0{N~^) + with 

probability l — 0{t^N~^) = 1 —o(l). Hence, with high probability, we reach a state 
with Pt = Then f{pt) = 0{pf) = and by another Chernoff 

bound (or Chebyshev’s inequality), pt+i = with high probability. But 

then f{pt+i) = 0 (pt_|_i) = and thus (conditionally given pt+i), the 

expected number of active vertices at time t + 2 is N'^f{pt+i) = = o(l), 

and thus with high probability there are no active vertices at all at time t + 2. □ 


Lemma 3. For k = 2,3, Pc = Xk{X), is a non-increasing function of X>0. 

Proof. If we increase A, then the average number of edges is increased. Moreover, if 
Gn{X) denotes the random graph with parameter A, and Ai < A 2 , then we 

can couple the random graphs Gn{Xi) and GAr(A2) such that GAr(Ai) C Gn{X2)', 
it is then evident that if all vertices eventually are activated in G]\[{Xi) (for a given 
initially active set), then so are all vertices in Gjv(A 2 ). The same holds for the 
mean-field approximation, where again we can couple two models with parameters 
Ai and A 2 , with Ai < A 2 , such that the set of activated vertices for Ai is a subset of 
the set of activated vertices for A 2 . It follows that in Theorem § Pc(Al) > Pc{X2), 
i.e.. Pc is a non-increasing function of A. 

An alternative, analytical, proof is given in the appendix. □ 


Corollary 1. Cases {iii) and (iv) of Theorem^can be sharpened as follows. 

(iii) For k = 2 and any X, Pc = X 2 {X), where X 2 {X) G (0, 2 : 2 ( 0 )] is a unique 
solution to X = f 2 {x) and 2 : 2 ( 0 ) « 0.132. 

(iv) For k = 3 and any X, Pc = X 3 {X), where X 3 {X) G (0, 2 : 3 ( 0 )] is a unique 
solution to X = 73 ( 2 :) and 2 : 3 ( 0 ) = 0.5. 

Proof The values 2 : 2 ( 0 ) = ^ - ^^(235 -f 6VU73)^ /^ - ]| (235 -f « 

0.131123, and ^ 3 ( 0 ) = | can be easily obtained from (4.22) and (4.23), respectively. 
By Lemmafor k = 2,3 we have that XkiX) < XkiO), i.e.. Corollary holds. □ 


It is also easy to see that for any fixed p > 0, if A is large enough, then the 
proportion of vertices active after the first step is more than, say, 0.6 > Pc, and 
thus eventually all vertices will be active. Consequently, Pc = Xk{X) —0 as A —>■ 00 . 
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Figure 1. pc as a function of A for fc = 2,3. 

In Theorem we obtained Pc with respect to A for different k values. Notice, 
that in the case of A —>■ 0, the solution tends to 0.5 and to 0.131123 for k = 3 and 
k = 2, respectively. The dependence of Pc on A (for k = 2,3) is shown on Figure 

Remark 2. Note that for k > b, an inactive vertex will remain inactive for ever. 
Hence, unless all vertices are activated at the beginning, there is at each step a 
set of inactive vertices. Furthermore, every neighbor of an inactive vertex becomes 
inactive; hence, for the graph every vertex will become inactive after at 

most N steps. For the mean-field approximation, every vertex has at least a fixed 
positive probability of becoming inactive at every step; hence (almost surely) every 
vertex will eventually become inactive in the mean-field approximation, too. 

5. Concluding remarks 

In this work we introduced the random graph model We derived bounds 

on the diameter of this graph and described its degree distribution. We studied the 
activation processes on Gj 2 ^^p^ in mean-field approximation. Specifically, we derived 
conditions for phase transitions as a function of initialization probability p and long 
edge parameter A. Moreover, we showed the boundedness and monotonicity of the 
critical probability as the function of A. One can also see from Figure [l] that Pc 
drops significantly for A S (0.1,10). 

Open questions include the generalization of these results for other lattice types 
and higher dimensions. An ongoing research concerns activity propagation in 
Gif^,Pd with two types of nodes (excitatory and inhibitory) [16]. 

Mean-field results provide useful insight on the activation processes. Neverthe¬ 
less, an important future task remains to investigate the activation process without 
using the ” averaging” feature of the mean-field approach. Open problems concern¬ 
ing the properties of G^j^^p^ and the activation process on the graph include: What 
is the number of small cycles? What is the clustering coefficient? A rough 0(log N) 
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upper bound on time required to activate all vertices in supercritical case follows 

from the proof of Theorem It would be interesting to obtain a sharper estimate. 
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6. Appendix. Analytic proof of Lemma [3] 

Proof. For A: = 2 or 3, denote the functions g{x) and h{x) from corresponding cases 
of the proof of Proposition]^ by gk{x) and hk{x), and let Fk{X,x) = gk{x) — hk(x). 
Then Xk{\) is a root of Fk{X,x) = 0. We have shown that gk{x) = hk{x) has a 
unique root in (0,1) and the proofs also show that the root is simple, so dFk/dx = 
g'j.{x) — h'f.{x) 0 at X = Xk{X). It follows from the implicit function theorem that 
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Xfc(A) is an infinitely differentiable function of A € (0, cx)), and that 


( 6 . 1 ) 


dxkiX) 

dX 


dFk/dX 

dFk/dx 


{X,Xk{X)). 


Now, Fk{X,l) = gfe(l) — /ifc(l) > 0, and thus Fk{X,x) > 0 ioi x > XkiX). 
quently, dFk/dx > 0 at a; = Xk{X). 


( 6 . 2 ) 


In the case k = 2, the numerator of (6.1) is 
dFo 


-^{X,X2{,X)) = X2{\) - (1 - a;2(A))'‘) > 0, 


Conse- 


because (1 — a; 2 (A))^ < 1 < Hence, dx 2 {X)/dX < 0 for any A > 0. 

For k = 3, the numerator of (6.11 is given by 


(6.3) -^^{X, x) = x — (1 — 2;)^(1 + 4x + Aa; — Aa;^)) = xF 2 {X, x) 

dX ^ ' 

at a; = a; 3 (A). We claim that /i 3 (x) > h 2 {x) for x G (0,1). Since g 2 {x) = gsix), 

this implies F 3 (A,a;) < F 2 {X,x). In particular, F 2 {X,X 3 {X)) > F 3 (A,a; 3 (A)) = 0 and 

thus ( |6.3| ) yields dF/dX{X,X 3 {X)) > 0; hence dxz{X)/dX < 0 by ( |6.1[ ). 

To verify the claim, we calculate h'i{x) — h 2 [x) = \x'^{l — xY(X'^x‘^ — (2A^ + 

10A)a; + A^ + lOA + 20). The square factors are positive on (0,1) and the quadratic 

factor has roots 1 + (5 ± \/5)/A. Since 1 + (5 ± ■\/5)/A > 1 for any A > 0, and 

furthermore the quadratic factor is positive at —oo, it is positive on (—oo, 1). Hence 

h^x) — h 2 {x) > 0 on (0,1). □ 
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